Merging for time inhomogeneous finite Markov chains, Part I: singular values and stability
نویسندگان
چکیده
We develop singular value techniques in the context of time inhomogeneous finite Markov chains with the goal of obtaining quantitative results concerning the asymptotic behavior of such chains. We introduce the notion of c-stability which can be viewed as a generalization of the case when a time inhomogeneous chain admits an invariant measure. We describe a number of examples where these techniques yield quantitative results concerning the merging of the distributions of the time inhomogeneous chain started at two arbitrary points.
منابع مشابه
Merging for inhomogeneous finite Markov chains, part II: Nash and log-Sobolev inequalities
We study time-inhomogeneous Markov chains with finite state spaces using Nash and Logarithmic-Sobolev inequalities, and the notion of cstability. We develop the basic theory of such functional inequalities in the time-inhomogeneous context and provide illustrating examples.
متن کاملMerging and stability for time inhomogeneous finite Markov chains
As is apparent from most text books, the definition of a Markov process includes, in the most natural way, processes that are time inhomogeneous. Nevertheless, most modern references quickly restrict themselves to the time homogeneous case by assuming the existence of a time homogeneous transition function, a case for which there is a vast literature. The goal of this paper is to point out some...
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملConvergence of some time inhomogeneous Markov chains via spectral techniques
We consider the problem of giving explicit spectral bounds for time inhomogeneous Markov chains on a finite state space. We give bounds that apply when there exists a probability π such that each of the different steps corresponds to a nice ergodic Markov kernel with stationary measure π . For instance, our results provide sharp bounds for models such as semi-random transpositions and semi-rand...
متن کاملSingularly Perturbed Markov Chains : Limit Results and Applications
This work focuses on time-inhomogeneous Markov chains with two time scales. Our motivations stem from applications in reliability and dependability, queueing networks, financial engineering and manufacturing systems, where two-time-scale scenarios naturally arise. One of the important questions is: As the rate of fluctuation of the Markov chain goes to infinity, if the limit distributions of su...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009